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Abstract 

We study the cohomology groups -ff 1 (A", &x(— mKx)), for m > 1, where A" is a 
smooth minimal complex surface of general type, Ox its holomorphic tangent bundle, 
and Kx its canonical divisor. One of the main results is a precise vanishing criterion 
for H l (X,Q x {-K x )) (Theorem [TTJ. 

The proof is based on the geometric interpretation of non-zero cohomology classes 
of H 1 (X, Qx{—Kx))- This interpretation in turn uses higher rank vector bundles on 
X. 

We apply our methods to the long standing conjecture saying that the irregularity 
of surfaces in P 4 is at most 2. We show that if X has prescribed Chern numbers, 
no irrational pencil, and is embedded in P 4 with a sufficiently large degree, then the 
irregularity of X is at most 3. 
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1 Introduction 

From Kodaira-Spencer theory of deformations of complex structures, [10], it is known 
that for a smooth complex projective variety X with holomorphic tangent bundle &x, 
the cohomology group H (X, @x) parametrizes the infinitesimal deformations of complex 
structures on X — hence the importance to study this group. In this paper we propose to 
study its twisted versions. More precisely, let X be a smooth minimal complex surface 
of general type and consider the cohomology groups H l (X, @x(— mKx)), where m is a 
positive integer and Kx the canonical divisor of X. The basic question we wish to address 
is the vanishing (respectively the non-vanishing) of these groups. It is customary to call 
elements of H l (X, ®x) Kodaira-Spencer classes. Following this tradition, we will refer to 
classes of H l (X, @x{— mKx)) as twisted Kodaira-Spencer classes of degree m. 

Of course, if Kx is ample the general result of Serre on sheaf cohomology implies the 
vanishing of H (X,&x(—mKx)) for all m sufficiently big. On the other hand, if Kx is 
not ample, then X carries (—2) curves, i.e. smooth rational curves C with C 2 = —2 and 
C ■ Kx = 0. Furthermore, it is easy to see that every (—2) curve on X gives rise to a 
non-zero class in H 1 (X,®x(—mKx)), for all positive m (see (b) in Remark 12. 5p . This 
observation indicates that the twisted Kodaira-Spencer classes contain a rather precise 
geometric data. In fact our main line of investigation as well as the strategy for proving the 



vanishing are very much modeled on this observation. Namely, we seek to extract geometric 
data from non-zero classes in H (X, &x(— TnKx))- Once this is done, we impose suitable 
hypotheses on X to rule out the existence of such data and thus obtain the vanishing of 
Qx(-TnKx))- The following is one of the main results of the paper illustrating our 
approach. 

Theorem 1.1. Let X be a smooth minimal complex surface of general type such that 
its Chern numbers satisfy C2{X)/K\ < 5/6. If X contains no smooth rational curves with 
self-intersection —2 or —3, then 

H 1 (X,Qx(-Kx)) = Q. 

This result points to the following general paradigm regarding the groups 
H x (X,® x {-mKx)), for m > 1: 

// the topological invariants of X are suitably constrained, then the non-vanishing 
of H 1 (X,&x(— m Kx)) implies the existence of configurations of special curves on 
X. 

This heuristic principle is realized in case m = 1 by the following technical result which 
constitutes the backbone of our considerations and might be of independent interest. 

Proposition 1.2. Let X be a smooth minimal complex surface of general type such that 
its Chern numbers satisfy &2,{X)jK\ < 1. If H 1 (X,@x(—Kx)) 7^ 0, then the canonical 
divisor Kx admits a decomposition 

K X = L + E (1.1) 

subject to the following conditions: 

(i) L has the Iitaka dimension 2, and 

(ii) E is a non-zero effective divisor which is numerically effective (nef), unless E con- 
tains irreducible components C such that C ■ E = —2 or —1. Such components are 
smooth rational curves of self-intersection —2 or —3. 

A way to prove Theorem 11.11 can now be summarized as follows: The hypotheses of 
Theorem ll . 1 l impose severe restrictions on the decomposition in (jl.ip and these restrictions, 
in their turn, lead to a contradiction. Hence H 1 (X,Qx(—Kx)) must vanish. 

Now, we will explain how to pass from the non- vanishing of H l {X, Qx(-Kx)) to the 
decomposition in (II. ip and to its various geometric properties. The main idea is to use 
the identification 

H\X, ®x(-K x )) = Ext 1 ^, Ox(-Kx)), 

where £lx is the cotangent bundle of X (see [T3] for a similar approach). We can and will 
view a non-zero class £ G H l {X, Qx{—Kx)) as the corresponding extension, i.e. the short 
exact sequence of locally free sheaves on X 

0— ►Ox(-.K'x)— >7i— — >0. (1.2) 
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Our attention shifts to the middle term sheaf Te. It is locally free of rank 3, with Chern 
invariants 

c i(7i) = ° and c 2 {T{) = c 2 - K x . 

The hypothesis c 2 (X)/K x < 1 yields that 7g is unstable in the sense of Bogomolov. 
Considering its Bogomolov destabilizing subsheaf is the key to obtaining the decomposition 
in (jl.ip . This subsheaf, which we call J-, must be of rank 2, and its determinant provides 
the divisor L in the decomposition (II, lj) . To see the other part of the decomposition, we 
observe that the inclusion of J- in 7^ combined with the epimorphism in (II, 2D induces a 
morphism 

which is generically an isomorphism. Furthermore its rank must drop along a non-zero 
divisor. This is the divisor E in With the decomposition established, it is rather 

straightforward to obtain some information on the numerical properties of the decompo- 
sition, such as L 2 , L ■ Kx, E 2 , E ■ Kx (see (|2.2j) . But one can go further on by getting 
rather detailed information concerning the irreducible components of E. This constitutes 
the most technical part of the paper. 

The above discussion clearly shows that the non-zero twisted Kodaira-Spencer classes 
contain quite precise geometric information and one might be tempted to say that for 
understanding the geometry of X, it is more useful to have the non- vanishing of the 
groups H 1 (X,Qx(—mKx)) for some m > 0, rather than their vanishing. 

Theorem 11.11 belongs to the category of "effective vanishing theorems" . It could also 
be viewed as a cohomological criterion for the existence of particular rational curves on 
surfaces of general type. This, in itself, can be quite helpful. At the same time, the groups 
of the more general form H 1 ^, Qx(—D)), with D a "positive" divisor, come up in various 
contexts. So the control of these groups can be useful for applications. 

One immediate application comes from the deformation theoretic interpretation of 
^(X, @x(— D)). Similar to the usual Kodaira-Spencer classes, the twisted ones in 
H (X, ®x{— D)) can also be viewed as infinitesimal deformations. Namely, one considers 
deformations of pairs (X, C), where X is a surface of general type and C is a smooth curve 
in the linear system | D |. The group H 1 (X, @x{— D)) parametrizes the infinitesimal de- 
formations of (X, C) where the corresponding infinitesimal deformation of the curve C is 
trivial. In other words H l (X, @x(— D)) can be identified with the Zariski tangent space 
along the fibre through (X, C) of the forgetful functor 

F : (X, C) h+ C. 

So the vanishing of H l {X, Ov(— D)) would tell us that this functor gives an immersion 
between the corresponding stacks. Thus Theorem 11.11 yields the immersion of 95T^- 2 C2 j the 
stack of pairs (X, C), where C is a smooth curve in the canonical linear system \Kx \ and 
X is subject to the hypotheses of Theorem ll.il into DJl K 2 + i, the stack of smooth projective 
curves of genus gc = K x + 1. 

Corollary 1.3. // < g> then the forgetful functor F : Wl P K2 C2 — > Wl K 2 +1 is an 
immersion if the canonical system \Kx\ contains a smooth curve. 
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The second application developed in the paper comes from the general observation 
that the groups of the form H l (X, @x{~ D)) (D is, as before, some positive divisor on X) 
control a certain amount of the extrinsic geometry of X. More precisely, if X is embedded 
in a smooth projective variety Y, then the normal bundle Afx/Y of X in 7 is related 
to the tangent bundle @x of X via the normal sequence. Hence the relation between 
H°(X,M X/Y (-D)) and H\X,<d x {-D)). 

It may happen that for some a priori "extrinsic" reasons, one knows that the coho- 
mology group H° (X , Mx/y (~ D)) ^ 0. Then, provided that the coboundary map 

H°(X,M X /y(-D)) — ► B\X,Q X {-D)) 

is not zero, one obtains the non-vanishing of H l (X, Qx(— D)). This, according to our 
heuristic principle, should impose topological and geometrical constraints on X. It poten- 
tially opens a way to having restrictions on the topology /geometry of surfaces embeddable 
in a given smooth projective variety Y. We summarize this "extrinsic - intrinsic" reasoning 
in the following diagram. 



Extrinsic Intrinsic 

data data (1-3) 

of X in Y of X 



We apply this line of thinking to surfaces in P and in particular to the long standing 
conjecture about the upper bound on the irregularity of surfaces in P 4 . This says that 
the irregularity of such surfaces is at most 2. For a more ample discussion of the history 
and the background of this problem we refer the reader to [13] and the references therein. 
To our understanding, there is no conceptual reason for such an upper bound and this 
estimate is largely based on the lack of examples. However, by exploiting non-zero twisted 
Kodaira-Spencer classes for appropriate twists of @x, we are able to show the following. 




Theorem 1.4 (= Theorem 15. ip . Given a positive integer x an d a rational f3, 2 < 
/3 < 9, there is a number do(x,/3) such every smooth minimal surface X C P 4 of degree 
d > do(x,(3), with xiPx) = X; K\ = fixiPx), and having no irrational pencil, has the 
irregularity at most 3. Furthermore, if the irregularity is equal to 3, then X must be subject 
to the condition (i) or (ii) in Lemma\5.4\ 



Let us explain how this result and its proof fit into the general heuristic scheme (|1.3j) . 
To begin with, the constant do(x, ft) and the condition d > do(x> P) of Theorem 11.41 provide 
an a priori extrinsic piece of information for the pair (X, P 4 ) on the left side of the diagram 
(|1.3|) . This datum is the existence of a 3-fold of degree mx < 5 in P 4 containing X. This 
observation is essentially due to Ellingsrud and Peskine in [6]. Then, the right oriented 
arrow in (II. 3p translates the existence of this 3-fold into the intrinsic datum of the non- 
vanishing of H 1 (X, &x(— D)), where D = Kx + (5 — mx)H, and where H denotes the 
divisor class of hyperplane sections of X C P 4 . A version of Proposition 11.21 implies a 
decomposition, as in (jl.ip . of the canonical divisor. It should be pointed out that in this 
version we use the hypothesis on irrational pencils instead of the inequality between the 
Chern numbers of Proposition 11.21 The intrinsic datum of the decomposition of Kx is 
then translated back into extrinsic data by establishing a relationship between L in (11.11) 
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and the hyperplane section H — this is the left oriented arrow in (|1,3|) . Our bound on the 
irregularity of X is an immediate consequence of this relation. 

Though Theorem 11.41 is a long way from the unconditional bound of the conjecture, 
it seems to be useful since it suggests that one of the conceptual reasons for not having 
surfaces in P 4 with large irregularity is the non-vanishing of cohomology groups of the 
form H 1 (X,@x(—D)) for an appropriately chosen "positive" divisor D on X. 

The arguments developed in the proof of Theorem II. 41 can also be used to show that for 
high degree surfaces in P 4 with bounded holomorphic Euler characteristic, their topological 
index is negative. (See Theorem 15.51 for the precise statement.) 

Let us end this section with some comments and questions. Theorem 11.11 together 
with the additional assumption that the canonical linear system | Kx | contains a reduced 
irreducible member implies the vanishing of H l (X, Qxi—rnKx)) for all m > 1 (Corollary 
I4.4p . This gives a complete answer to the question about the vanishing of the groups 
H l {X,Qx{—mKx)), m > 1, for a large class of surfaces of general type. However, the 
situation is not fully satisfactory with regard to the hypothesis in Theorem 11.11 concerning 
the (— 3)-curves — we do not know if this assumption is really necessary. Let us explain 
this point. Contrary to (— 2)-curves, the (— 3)-curves, by themselves, do not produce 
cohomology classes in H l {X, @x(— Kx))- These curves appear naturally in the course of 
the study of the decomposition of Kx = L + E in (11.11) . But each (— 3)-curve must appear 
in the divisor E as a part of a rather involved configuration of other curves, and at this 
stage, we are unable to treat these configurations efficiently. 

It should also be noticed that the problem of (— 3)-curves disappears for the groups 
^(X, Qx(-mKx)), with m > 4, and our approach allows to have a purely cohomological 
criterion for the existence of (— 2)-curves on surfaces of general type (that will appear 
elsewhere) . 

We also believe that the groups H (X, 6x(-mKj()), for all m sufficiently large, must 
be spanned by the twisted Kodaira-Spencer classes associated to (— 2)-curves. Another way 
to put it, the twisted Kodaira-Spencer classes of sufficiently high degree should provide 
a stronger version of the decomposition of type (jl.ip where the divisor E is composed 
entirely of (— 2)-curves. 

We limited our discussion to surfaces of general type. However, it is clear that our 
approach is valid in higher dimensions as well and one can ask if it is possible to have a 
result analogous to Theorem 11.11 in dimensions bigger than 2. 

The paper is organized as follows. In §2, we prove the decomposition (jl.ip and derive 
the basic properties of the divisor L in this decomposition (see Lemma 12.11 and Lemma 
I2.2p . The third section is devoted to a detailed study of the irreducible components of the 
divisor E in (II. ID . In §4, we give a proof of Theorem 11.11 Finally, in §5, the two results 
about surfaces in P are considered (see Theorem 15.11 and Theorem 15. 5p . 

Notation and conventions. 

X is a smooth minimal complex surface of general type unless otherwise stated. 
Kx is the canonical divisor of X. 

K x , C2^X), and x(®x) are the Chern numbers and the holomorphic Euler characte- 
ristic of X respectively. 
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C2(X) 



@x is the holomorphic tangent bundle of X and fix is its holomorphic cotangent 
bundle. p g (X) = h 2 {X,O x ) = h (X,O x {K x )) and q(X) = h l {X,O x ) = h°(X,n x ) are 
respectively, the geometric genus and the irregularity of X. 

For a coherent sheaf Q on a variety M, the cohomology group H l (M, Q) is denoted by 
H l (Q) if no confusion is likely. 

For an effective divisor D = J2 a ^aC a on a surface X, where the C a are reduced 
irreducible curves, D Ted denotes the reduced associated divisor ^ a C a . 

All equalities between divisors take place in A 1 (X) of the Chow ring of X except the 
ones involving the Zariski decomposition. In these cases, the equalities are considered in 
the Neron-Severi group NS(X) Q = NS(X) ® z Q. 



2 The non- vanishing of H l (X,Q x {-K x )) and 

THE DECOMPOSITION OF K x 

In this section we show how the existence of a non-trivial element in @x{— Kx)) 

gives rise to a distinguished decomposition of the canonical divisor Kx of X. 

Lemma 2.1. Assume the Chern numbers K 2 and C2(X) are subject to 

C2(X) 

a x = —pr- < 1 

and assume ^{X^Qxi—Kx)) to be non-zero. Then the canonical divisor Kx admits the 
decomposition 

K X = L + E 

where L has Iitaka dimension 2 and E is effective and non-zero. 

Proof. A non-zero element £ 6 H 1 (X, @x{— Kx)) via the natural identification 

H\X,Q X (-Kx)) = ^t l (VL x ,Ox(-K x )) 

defines the extension 

— > Ox(-Kx) ^Ts^n x ^0. 

The sheaf 7^, seating in the middle of the sequence, is locally free of rank 3 and its Chern 
invariants are 

c i(7i) = and c 2 (7^) = c 2 - K.\. 

The assumption ax < 1 implies that 7^ is Bogomolov unstable. Let T be its Bogomolov 
destabilizing subsheaf. One knows that its determinant det T = Ox(L) is in the positive 
cone of NS(X)q (see [3]). This and the fact that the cotangent sheaf tlx cannot have 
subsheaves of rank 1 and of Iitaka dimension 2 imply that the rank of T is 2. Furthermore, 
we may assume it to be saturated. Then the quotient 7^/ T is torsion- free and T^jT ~ 



6 



Jz{—L), where Z is a subscheme of codimension 2 and J% is its sheaf of ideals. This 
yields the following diagram. 



(2.1) 



>O x (-K x ) 




-*n x — > o 




Jz(-L) 







Using again the fact that £l x has no rank 1 subsheaves of Iitaka dimension 2, we conclude 
that the morphism iff in (|2.1[) is generically an isomorphism. In addition, its cokernel, 
coker tp^, is a sheaf supported on a codimension 1 subscheme since otherwise would be 
an isomorphism making the extension class £ trivial. The resulting exact sequence 







coker cp^ — > 



yields the asserted decomposition 

K x = L + E 

with L of Iitaka dimension 2 and E = c\ (coker <pc) effective and non-zero. 



□ 



We begin the study of the decomposition of Kx in Lemma 12.11 by recording some 
properties of L. 

Lemma 2.2. The divisor L in Lemma \2A\ admits the Zariski decomposition 

L = L + + zr 

where L + , the positive part of L, is nef and big, and L~~ is the negative part of L. Fur- 
thermore, L is subject to the following numerical conditions: 



L 2 >^(l-a x )K x and L ■ K x > J |(1 - a x ) K 2 X . 



(2.2) 



Proof. By construction, L has Iitaka dimension 2, hence it has the Zariski decompo- 
sition L = L + + L~ as asserted. 

The two inequalities of the lemma come from the diagram (|2.ip . Namely, combining 
its vertical and horizontal sequences yields 

c 2 (X) -K\= c 2 (F) - L 2 + deg Z. 



As we have specified in the introduction, the equality L — L + + L takes place in NS(X)^ 
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Since J 7 is a rank 2 subsheaf of the cotangent sheaf Six an d det(J r ) = O x (L) has Zariski 
decomposition, a result of Miyaoka, [121 Remark 4.18], says that its Chern invariants are 
subject to 

Combining the two inequalities, we obtain 

L 2 > \{K\ - c 2 {X)) + 1 degZ - l -(L~? > |(1 - a x )K x , (2.3) 

thus the first of the asserted inequalities. The second follows from the first and the Hodge 
index theorem (L • K x ) 2 > K 2 L 2 . □ 

The following lemma compares the two divisors, L and E, of the decomposition in 
Lemma 12.11 



Lemma 2.3. Let Kx = L + E be the decomposition in Lemma \2. 1 

1) // a x < 5/6, then L ■ K x > E ■ K X - 

2) If a x < 1/2, then (L — E) 2 > 0. 

Proof. To prove 1), assume L ■ Kx < E ■ Kx- Then, 

L-K x <E-K X <K 2 X -L-Kx, 

and using (12. 2D . we obtain 



K\ >2L ■ K x >2J|(1 - a x ) K 2 X . 

Hence 1 > ^/6(T — ax), i-e. ax > 5/6. 

To prove 2) we use the hypothesis ax < 1/2 and (|2.2p to arrive at 

(L - E) 2 = (2L - K x ) 2 = 4L 2 - 4L • K x + K 2 X > 6(1 - a x )K\ - 4L • K x + K\ 

> m 2 x -AL-Kx+K 2 x = \{K 2 X - L ■ K x ) = AE-K x >0. 

□ 

In the sequel, we will need the following cohomological property of the divisor E. 

Lemma 2.4. Let e be a section ofOx(E) corresponding to the divisor E. Then e-£ = 
inH\Q x {E-K x )). 

Proof. Dualizing the diagram (|2.ip and tensoring it with O x (—L) give the following 
diagram. 

Ox (2.4) 




¥& X (-L) >V(-L) >Ox(Kx-L) ► 
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We see that the coboundary map 

H°(O x (E)) — > H\® x (-L)) = H\Q X {E - K x )) 

given by the cup-product with the class £ contains the section e in its kernel. □ 

Remark 2.5. (a) The equality e • £ = in Lemma 12.41 implies that £ is supported on 
the divisor E = {e = 0}. More precisely, from the exact sequence 

H°(Q X O e (E - K x )) — ► ff x (©x(-^x)) H l (Q x {E - K x )) 

it follows that £ is the image of a unique global section of Gx <8> Oe(E — Kx)- 

(b) In case E is a (— 2)-curve, one has a converse, i.e. i£ defines a unique (up to a 
non-zero scalar multiple) non-zero cohomology class in Kx))- This follows since 

B x ® O e (E - K x ) = &x® O e (E) ^&x® P i(-2) P i C P i(-4), 

and hence i?°(Gx ® O e (E - K x )) = H (O F i O p i(-4)) = C. The same argument is 
valid for all H 1 (@x(— m Kx)), where m > 1. Thus, a (— 2)-curve gives rise to a non-zero 
cohomology class in every group H 1 (Qx{— m Kx))- l m >1. 



3 The study of the irreducible components of E 

This section is entirely devoted to a study of the divisor E of the decomposition in 
Lemma 12.11 

Lemma 3.1. The divisor E passes through the subscheme Z. 

Proof. To see this, it suffices to show that h°(X, Jz{E)) ^ 0. This follows by tensoring 
the morphism ip^ in (|2.1|) with Ox(Kx)- D 

From the vertical sequence in (|2,ip . the subscheme Z can be seen as the zero-locus of 
a section s^ € H (X,Tg(—L)). Using this section, we can define the restriction of Z to a 
component of -E. More precisely, for every component C of E, denote by Zq = {s^\c = 0}. 

The main tool for a detailed study of E is the following construction. We take the 
second exterior product in diagram (|2.ip to obtain the diagram, 

O x (L) (3.1) 




>O x >A 2 7i >Ox{K x ) > 

where e is a section of Ox(E) corresponding to the divisor E. For any component C 
of E, the morphism in (13. ip given by e vanishes over C and hence it induces a non-zero 
morphism 

T C :Oc{L)^e x ®Oc 
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whose zero locus is Zq. If C is a reduced and irreducible component of E, we combine 
this morphism with the normal sequence of C in X to obtain the following commutative 
diagram. 

Oc(L) 

TO \. 

>O c >&x®O c >O c (C) 

The irreducible components C of E will be distinguished according to the properties of 
the morphism tpc- 

type I: If ipc = 0, in this case tq factors through the tangent sheaf 0c of C and the 
degree of Zc is subject to 

deg Z c < deg Vc (Z c ) = 2 - 2g(C) - C ■ L, (3.2) 

where r]c '■ C — > C is the normalization of C (see |14| . pp. 432-433, for details). Such a 
component will be called of type I. 

type II: If ipc 7^ 0, in this case ipc defines a non-zero section of Oc(C — L) vanishing 
on Zc, and hence 

deg Z c < C 2 - C ■ L. (3.3) 
We will call such a component of type II. 

The divisor E can be written as the sum of two parts, 

E = Ei + E n , (3.4) 

with 

Ej := m c C and Ejj := mc C, 

C of type I C of type II 

where mc denotes the multiplicity of a component C in E. 

The following lemma relates the components of En and the Zariski decomposition of 

5 

L in Lemma 12.21 under the additional assumption ax < — of Theorem 11.11 

6 

5 

Lemma 3.2. Let ax < —■ Then every irreducible component C of E of type II must 

6 

also be a component of L~ and 

C ■ L < C 2 < 0. 
Furthermore, the multiplicity of C in L~ is > 1. 



Proof. From (13 .3p . we deduce C ■ L < C . First, we claim that C ■ L < 0. Indeed, if 
C ■ L is positive, then C 2 > 0. From this and the Hodge index theorem, (C • L) 2 > C 2 L 2 , 
it follows that 

C 2 > C ■ L > L 2 > - (1 - ax)K\ (3.5) 
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where the last inequality comes from Lemma 12.21 This and the Hodge index (C • Kx) 2 > 
C 2 K\ yield 

E ■ Kx > C ■ Kx > J^(l-a x )K x . 
Combining this with the second inequality of Lemma 12.21 we obtain 

K 2 X = L-Kx + E-K x >2 ^(l- ax )K 2 x . 

But this yields ax > 5/6, contrary to our assumption. 

Next combining the inequality C ■ L < with the Zariski decomposition L = L + + L~ 
we obtain that C 2 < 0. This, together with L • C < C 2 , yields L ■ C < 0. Hence C must 
be a component of L~. 

Turning to the last assertion of the lemma, let [iq De the multiplicity of C in L~ . Then 

> C ■ L - C 2 = C ■ (L + + L~) - C 2 = C ■ L~ - C 2 > (/x c - l)C 2 , 

hence /Uc* > 1. □ 

In analyzing the components of type I, we will repeatedly make use of the following 
lemma. 

Lemma 3.3. The singular locus of Ej ed is contained in Z E r C d. (Recall, that for an 

effective divisor D = Yla^aCa, where C a 's are reduced irreducible curves, D red denotes 
the reduced associated divisor ^ Q C a .) 

Proof. Taking the restriction of the diagram (|3.ip to E T f d implies that, outside Z E r C d, 
the sheaf Q E wd is isomorphic to the locally free sheaf E red{L). By a result of Lipman, 
[TTj . this implies that E r j ed is smooth outside the subscheme Z E red. □ 

Next we turn to the Zariski decomposition of E. We first determine the curves inter- 
secting E negatively. 

Lemma 3.4. Assume Kx to be ample. IfC is a reduced irreducible curve on X such that 
C ■ E < 0, then C is a smooth rational component of Ej satisfying C 2 = —3, C ■ E = — 1, 
and C ■ L = 2. Furthermore, C does not intersect any other component of Ej. 

Proof. The inequality C ■ E < implies that C is a component of E and that C 2 < 0. 
Since Kx is ample, 

C -L = C ■ {K x - E) > 2, (3.6) 

so by (|3.3p . C must be a component of type I and according to (|3.2p . C ■ L < 2. This 
inequality and (13. 6\\ yield C ■ L = 2 and Zc = 0- The latter, combined with Lemma 13.31 
implies that C is a smooth rational curve with C ■ Kx = 1, i.e. C is a (— 3)-curve, and 
that C intersects no other component of Ej. □ 

Remark 3.5. If we drop the assumption of ampleness for Kx, then the inequality in 
(|3.6I) implies that the intersection C ■ E is either —2 or —1. The first case implies that C 
is a (— 2)-curve, while the second leads to two possibilities: either C ■ L = 1 and C is again 
a (— 2)-curve, or C ■ L = 2 and C is a (— 3)-curve. 
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Proposition 3.6. Let K x be ample and set 9t_i = {C \ C ■ E = -1}. Then the 
Zariski decomposition of E is E = E + + E~ , where 
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In particular, E + ^ 0. 



Proof. We know that E ^ 0. Let E + = E — E~ , with E~ defined as above. It is 
sufficient to show that C-E + = 0, for any C € !SH_i, and that E + is nef. The non-triviality 
of E + then follows immediately. 

We begin by checking that the curves in are orthogonal to E + . To do this, we 
observe that if T E then T ■ L = 2; from (13. 2|) . it follows that the subscheme Zr is 

empty. Using Lemma 13.31 we see that T intersects no other curve from hence 

V ■ E + = T ■ (e -- Cj=T-E--T 2 = 0. 

Next we show that E + is nef. Let us suppose that there exists a reduced irreducible 
curve T such that F ■ E + < 0. By the above argument, T ^ £R_i and 

o < r • e = r • e + + r • e~ < r • et. 

Putting together this inequality and the last assertion of Lemma 13. 4| we deduce that T 
is a type II component of E. The rest of the argument is an estimate of T ■ E. To begin 
with, 

F-E = T-(E I + E n ) >F-Ej + m r T 2 , 
where mp is the multiplicity of T in E. Using (13.3H . 



r • E > T • Ei + m r (r • L + deg Z r ) > T ■ Ej + m r T ■ K x - m r T ■ E, 

hence 

T.E>^^T.K x + ^—Y. El >^-T.K x + ^— £ m c T ■ C. 
mr + 1 mr + 1 mr + 1 mr + 1 

C tin— i 

Since by Lemma |3.4| every C £ intersects no other curve in 

-1 = C-E = -3m c + C-E n > -3m c + m T C -T. 

Thus 

w-c > o I r • C + 1 



3 

Using this inequality and the last estimate for T ■ E, we arrive at 

T . E >^-T.K x + \^— J2 (m r T.C + l)T.C 
mr + 1 o mr + 1 

r.xx + i £ r-o 

mr + 1 o 
mr + 1 
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which leads to the contradiction 



o > r • e+ > mr r • k x > o. 

mr + 1 



□ 



Remark. The preceding argument shows that every type II component r of E inter- 
sects E + positively. More precisely, 

mp + 1 

where mr is the multiplicity of T in E. 

Putting together Lemma 13.21 with the property (j3.2|) of curves of type I, we obtain the 
following. 

5 

Proposition 3.7. Assume ax < — and let C be an irreducible component of E. Then 

6 

• either C ■ L < and then C is orthogonal to L + , the positive part of the Zariski 
decomposition of L, 

• or C ■ L > and then C is a smooth rational curve of type I with C ■ L = 1 or 2. 

Proof. We consider C according to the sign of its intersection product with L. If 
C ■ L < 0, we use the Zariski decomposition of L = L + + L~ in Lemma 12.21 to deduce that 
either C is a component of L~ , in which case C ■ L + = 0, or it is not, in which case 

< C ■ L + = C ■ (L - IT) < -C ■ L~ < 0, 

hence again C ■ L + = 0. 

If C ■ L > 0, then, by Lemma 1331 the curve C is of type I, and by (|3.2|) . 

< 20(C) < 2 - C ■ L - deg Z c < 2. 

This implies that C ■ L < 2 and g(C) = 0. Furthermore, by Lemma 13.31 C is smooth 
outside the subscheme Zc, while the inequality (|3.2p . 



deg(Z c ) <deg Vc (Z c ) < 1, 

implies that Zc is either empty or a smooth point of C. □ 

5 

Corollary 3.8. Assume Kx ample and ax < —■ Then for every irreducible compo- 

6 

nent C of E, 

C ■ L + < 1 

Furthermore, if C ■ L + > 0, then C is a smooth rational curve of type I such that 
C-L = j and C-E}f = j-1, j e {1,2}. 
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Proof. Let C be an irreducible component of E. Using the previous proposition, we 
know that C ■ L + = unless C is a smooth rational curve of type I such that C ■ L = j, 
j G {1, 2}. Let C be such a rational curve with C ■ L + > 0. Clearly C is not a component 
of L~ , hence C ■ L~ > 0, and we have 

C-L+=j-C-L~. (3.7) 

In view of Lemma [3.21 if j = 1, the curve C cannot intersect any type II component of E, 
i.e. C-Efj d = 0. 

We now turn to the case j = 2. First we will show that C ■ En > 0. To see this, notice 
that 

C-E n = C-E-C-E I >-l-C-E I , (3.8) 

where the last inequality uses Lemma 13.41 From C ■ L = 2 and the inequality ([3. 2ft , it 
follows that Zc = 0. Hence, according to Lemma [3.31 C intersects no other component of 
Ej, i.e. C ■ Ej = mcC 2 , where mc is the multiplicity of C in Ej. Substituting it in (13.81) 
leads to 

C -E u = -l-m c C 2 > 0. 

Thus, there are irreducible components T in Ejj intersecting C non-trivially. Since, by 
Lemma [372], each such T appears in L~ with multiplicity fj,r > 1, the equality fj3.7j) implies 
that there exists a unique T in Ejj intersecting C and Y ■ C = 1. Hence C ■ E r j e j d = 1 and 
C-L+<1. □ 

Remark 3.9. From Corollary 13. 8l it follows that the main reason for the non-vanishing 
of H l (®x{— Ex)) resides in the existence of curves C of type I with C ■ L + > 0. Indeed, 
suppose that there would be no such curve. Then C ■ L + = for every component C of 
E. This gives E + ■ L + = 0. Since E + is nef and non-zero, this is impossible. 



4 The proof of Theorem 11.11 

We now assume that Kx is ample and ax < 5/6. We seek to obtain a contradiction 
to the decomposition 

K x = L + E 

of Lemma 12.11 Our main idea is to compare E 2 and E ■ L + . This will be realized by 
using the properties of the divisors L and E accumulated in the previous sections. In view 
of Remark 13. 9[ we need to deal with the smooth rational curves C of type I subject to 
C ■ L + > 0. By Corollary 13.81 these are components of Ej satisfying either C ■ L = 1, or 
C ■ L = 2. For this reason, we introduce the sets 

W = {C\C CE + ,C-L = j}, j = l,2. (4.1) 

We have seen in Proposition 13.71 that every curve in 9V is smooth and rational. For any 
integer k, set 

<fi> k = {C G W | C ■ E = k}. 



14 



Since every C € 9V verifies < C ■ Kx = j + C ■ E, the sets 9V are partitioned by the 
subsets d\ 3 k as follows: 

9a 1 = 9^ U 9l>! and 9* 2 = 9l 2 x U 9ig U 9^ 

where W? >x = [j 

k>l 

Remark. 9\ 2 _ 1 = 9t_i, c/. Lemma ETH 

Using Proposition 13.71 and the above partitions of the sets 9^, 

E = Q+ Yl m cC+ m cC+ Yl m c°' ( 4 - 2 ) 

where Q contains all the components lying in (j = 1, 2) and those for which C-L + = 0. 

Lemma 4.1. //X contains no (—3)-curve, then 9^g = 9vl 1 = and -E 1 is nef. 

Proof. If C is a smooth rational curve in 9^oU9v 2 _ 1 , then C-Kx = 1 and C 2 = —3. Hence 
the first assertion. The second one follows immediately from the Zariski decomposition of 
E in Proposition 13.61 □ 

From now on we also assume that X contains no (— 3)-curves. With this hypothesis, 
our idea of comparison of E 2 and E ■ L + takes the following form: 

Lemma 4.2. E 2 > E ■ L+ . 

Let us assume the lemma and complete the argument. First, notice that this inequality 
implies E 2 > 0. Then, by the Hodge index theorem, 

E 2 >(L+) 2 >L 2 >^(l-ax)K 2 x, 

where the last inequality comes from (|2.3p . Arguing as in the proof of Lemma 12.21 we 
obtain 

E-K x > ^(l-a x )K 2 x and L + ■ K x > ^(l-a x )K 2 x . 

Thus 

K\ > (L+ + E) ■ K x > ^6(l-a x )K x , 

yielding ax > 5/6, which contradicts the hypotheses. At this stage Theorem II. II is proved 
and we turn to 

Proof of Lemma \4-%\ Combining (|4.2p , Lemma 14. 1\ and Corollary 13.81 we obtain 

(E - Q) ■ L+ = ( Y rncCj • L+ < £ m c , (4.3) 

where 

= {C E £Hg | C ■ L + > 0}. 



15 



It is clear that the curves in do not lie in L~~. Furthermore, by Corollary 13. 8} every 
C in 9\o intersects a unique irreducible component of type II. Denote this component by 
T(j. The correspondence C i-> Tc gives rise to the map 

p : <K — > Irr(Sjj), 

where Irr(-Ejj) stands for the set of irreducible components of Ejj. Using p, we will be 
able to replace the multiplicities mp in (|4.3p by the ones of the curves T € Irr(£7/). This 
is done as follows. 

Let T be a curve in Iri(Ejj) and set SHoCH = p~ 1 (r). Then for every C € 9^o(T) we 
have 

= C ■ E = C ■ {Ei + E n ) = -Am c + m r , 

since C 2 = —4, C ■ Y = 1, and C intersects no other component of E. Thus mr = 4mc. 
Substituting it in (|4.3p . yields 

(£_Q). L +< ^ mc = I £ nrmr , (4.4) 

Ce^o reIrr(B I7 ) 

where nr = card(p _1 (r)). 

Claim. If r is in Irr(£'jj) ; then 

T • E > -n r . 

Assuming the claim, let us complete the proof of Lemma [4. 2 1 We combine the inequal- 
ity of the claim and (|4.4p to obtain 

(E - Q) ■ L + < - n r m r < ^ m r T ■ E = E u • E. 

T&xr{E u ) relrr(-Ejj) 

This and the definition of Q yield 

E ■ L + <Q ■ L + + E H ■ E = ( m cC+ ^ m c C\ ■ L + + E n ■ E. 

^CGini.j cm 2 >1 ' 

Using Corollary 13.81 and the fact that E is nef (Lemma 14. ip , we obtain 

E ■ L + < ^2 mc + Eu-E 

< Y m c c -E + En-E 

ce<n 1 >1 u<nl 1 

< Ej ■ E + Ejj ■ E 

= E 2 . 

□ 



16 



Proof of the claim. We consider the divisor ^+ — ^2u e ^ ^ C J and argue according 
to its self-intersection, 



4 ^— ' / 4 



If r < , then we obtain 

4 

> r 2 > r • l = r • (k x - £) 

where the second inequality uses the fact that T is of type II and hence subject to the 
inequality (|3.3p . Thus we obtain 

t ■ e >r ■ k x - r 2 >^ + r ■ k x 

If r 2 > — J", we use the fact that the divisor ( V + — X)ceSHo(r) ^ J en t ers E with multi- 



plicity mr, «.e. 



S = m r fr+i c)+R r , 



where i?r is the residual part of E. This implies 



T-E = m r T- I T + i cj+r-i? r 



ceiHo(r) / (4.5) 



By 

Substituting into (14.5 



2 , n r«ir 
> mr 1 H 



r 2 > r • l = r • k x - r • £. 



r.£>m F r 2 + > m r (r • if x - r ■ + 

Solving for r • E, we obtain 

(m r + 1) T • E > m r T ■ K x + 
Summing up with (14, 5D leads to 

(m r + 2)T-E>m r (T-K x + T 2 ) + 1 ^- (4.6) 
and we continue to argue according to the sign of the expression (r • K x + T 2 ). 
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First case. If T • K x + T 2 > 0, then the inequality gSJ yields 

r • > — — ^ — ^— > — > — , 

- 2(m r + 2) ~ 3 4 ' 
where the second inequality follows from mp = Amc > 4. 

Second case. If T • Kx + T 2 < 0, then T ■ Kx + T 2 = —2 and T is a smooth rational 
curve. Substituting this relation in (|4.6p yields 

(m r + 2)T-E> -2m r + - J ^ ± - 

So 

r-E> m \,A n T -4). (4.7) 
2(m r + 2) 

Since T is a smooth rational curve, T 2 < —4 — the surface X contains neither (— 2)-curves 
nor (— 3)-curves. Together with the assumption T 2 > — — , this inequality implies that 
nr > 16. Using (|4.7p and nir > 4, we obtain 



^ ^ 1 / ,n n r nr 4 nr 
r- J E>-(n r -4)> — + — - ->— . 
~3 V y ~ 4 12 3 4 



□ 



It is reasonable to guess that once the group moKx)) vanishes for some too, 

the same should hold for all to > m.Q. This is justified by the following: 

Proposition 4.3. Let X be a smooth minimal complex surface of general type with 
Pg(X) > 1 and ax < 1- Let c be a global section of Ox(Kx) and let C = {c = 0} be the 
corresponding divisor. If C is reduced and irreducible, then the homomorphism 

i? 1 (9x(-(m + l)K x )) H l (Q x {-mK x )) 
of the multiplication by c is injective for all to > 0. 

Proof. Let £ be a non-zero class in H l (Qx{—{m + l)Kx )) such hat c • £ = 0. Using 
the identification 

H\e x (-(m + l)K x )) = Ext 1 (n x (mKx),Ox(-K x )), 

we view £ as the corresponding non-trivial extension class, i.e. the short exact sequence 
of vector bundles on X 

— > O^Kx) — ► T 5 — ► n x (miT x )) — > o. 

We dualize and consider the long exact sequence of cohomology groups 

— > H°(T^) — > ff o (0x(if x )) J ff 1 (G x (-m^x)) — ► • • • 
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where the coboundary map is given by the cup-product with the extension class £. The 
assumption o£ = implies that the section c is the image of a non-zero section s € H°(T^). 
This gives rise to the following commutative diagram. 

(4.8) 



Ox 



>Q x (-mK x ) 



V 



coker(s) 







^Ox(Kx) ► 



Furthermore, since the divisor C = {c = 0} is reduced and irreducible, and the extension 
£ is non-trivial, it follows that the sheaf coker(s) in fj4.8|) is torsion free. Dualizing again, 
we obtain the commutative diagram 







(4.9) 





-> Ox(-Kx) > T 5 > n X (mK x ) > 



Jz 







where Z is the subscheme of zeros of s, Jz is its sheaf of ideals, and T = (coker(s))* is a 
locally free sheaf of rank 2. 

From (14.91) we deduce the Chern invariants of T: 



c 1 (J r ) = 2mK x and c^T) = c 2 (X) + (m 2 - m - l)K x - deg(Z). 
This and the assumption ax < 1 imply 

4(F) - 4c 2 (7") = 4((m + l)K 2 x - c 2 (X)) + 4deg(Z) > 0. 
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Thus T is Bogomolov unstable and its Bogomolov destabilizing subsheaf Ox (F) gives rise 
to the exact sequence 

0— ►Oa-(F) F ^ J A (2mK x - F) — ► 0, (4.10) 

where ^4 is a 0-dimensional subscheme and J7a its sheaf of ideals. The fact that Ox{F) is 
the Bogomolov destabilizing sheaf also implies that the divisor 

Cl (O x (F)) - X - ci(J-) = F — mKx 

is in the positive cone of NS(X)q. But the morphism ^ in (|4.9p combined with (|4.10|) 
induces the monomorphism 

Ox(F-mKx) ^n x . 
Hence Ox has a subsheaf of rank 1 and Iitaka dimension 2 which is impossible. □ 

Corollary 4.4. Let X be a smooth minimal surface of general type such that ax = 
C2(X)/K X < 5/6 and the canonical linear system \Kx\ contains a reduced irreducible 
member. If X contains no smooth rational curves with self-intersection —2 or —3, then 

H l (® x (-mK x )) = 0, for all m > 1. 
Proof. Follows immediately from Theorem 11.11 and Proposition 14.31 □ 



5 The irregularity of surfaces in P 4 

The aim of this section is to study the geography of surfaces of general type X in P 4 
with fixed numerical invariants, d = degX, K x , and x{®x)- To this end we consider the 
set 

SdiXifi) '■= {X \ X C P 4 smooth surface of general type, (5.1) 

degX = d, X (Ox) = X,K 2 X = Px(O x )}, 

where /3 < 9. There is a general result due to Decker and Schreyer, [5[ Proposition 3.11] 
(see also [61 Proposition 3]), which establishes an upper bound on d for each given value 
of x- Here we will explore the irregularity of surfaces in Sd(x,(3). More precisely, for the 
surfaces in the subset S d (x, P) C Sd{Xi P) defined by 

S^iXi 0) := {X € Sd(x>@) I X minimal and with no irrational pencil} 

we are able to show the following: 

Theorem 5.1. Given a positive integer x an d a rational f3, 2 < j3 < 9, there exists a 
degree d(x, 0) such that, if d > d(x, 0), then every surface X G S° d {x, 0) has the irregularity 
at most 3. 

If the irregularity is equal to 3, our argument (see Lemma |5.4|) shows that X must be 
contained in a quintic 3-fold in P 4 and must satisfy one of the following conditions: 
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(i) fix ^ generated by global sections, and K\ = QxiPx)> 

(ii) the canonical divisor has the form 



K x = nH + F + ^2 m c C + £ 



CH=2 l-H=l 

where [i > 1, F is an effective divisor, and the sums run over collections of irreducible 
conies (C ■ H = 2) and lines (I ■ H = 1) contained in X . 

A proof of this theorem is a consequence of several lemmas. Though the proofs of some 
of those results are somewhat lengthy and sometimes involve considerations of several 
cases, the main principle behind all the arguments is quite transparent: the exploiting of 
the non-vanishing of @x(— Kx))- This non-vanishing gives rise, as in Lemma |2, 11 

to a decomposition of the canonical divisor Kx- Then we seek to relate this decomposition 
to the linear system embedding X in P . 

The non- vanishing of @x(— Kx)) turns out to be a cohomological version of 

the following result of Ellingsrud and Peskine in [6] . 

Lemma 5.2. Given the integer \ an d the rational ft, /3 < 9, there exists a degree d(x, /3) 
such that for all d > d{x,j3) and for every surface X in SdiXifi), there is a 3-fold in P 
of degree < 5 containing X . 

Proof. If X is embedded in P by the line bundle O x (H), the numerical invariants of 
X satisfies the well-known formula (see e.g. [8], p. 434), 

d 2 -Wd-5H ■ K x = 2K X -12 x (O x ), (5.2) 

or, using the geometric genus of a hyperplane section, gn, the adjunction formula, and 
the notation above, 

d 2 - 5d - 10(g H - 1) - 2{/3 - 6) X = 0. (5.3) 

By a result of Gruson and Peskine in [7] (the Halphen's bound), if d > 30 and a 
hyperplane section H is not contained in a surface of degree 5, then 

d 2 + 12d 

Qh — 1 < • 

M - 12 

Putting this together with (|5.3p yields 

d 2 - 5d - 2(B - 6)x < - (d 2 + 12d), 

6 

or, equivalently, 

d 2 - 90(i - 1209 - 6)x < 0. 

Set d{x-i /5) = 29 if the discriminant of the left hand side is negative. Otherwise, we solve 
the inequality for d and set 



d(x, P) = max(29, 45 + y^ 2 + 12(/3 - 6)x) • 
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Then, if d > d(x, 0), the hyperplane sections of X must be contained in a surface of degree 
< 5. This and the classical result of Roth ([15], p. 152, see also [6], (C), p. 2) imply that X 
is contained in a 3-fold of degree < 5 in P 4 , provided d > d(x,(3)- O 

Let Jx be the ideal sheaf of Z in P 4 . Set 

m x ■= min{m G Z | h°(J x (m)) / 0}, (5.4) 

i.e. mx is the minimal degree of hypersurfaces in P 4 containing X. 

Let Mx be the normal bundle of X in P 4 and let M x be its dual, the conormal bundle. 
The normal bundle is a rank 2 bundle on X with determinant bundle det(Mx) = A 2 A/"x = 
Ox{Kx + 5-ff), where H is a hyperplane section of X, i.e. O x {H) = P 4(1) ® O x . This 
implies 

M x = det(M*)®M x = Mx(-K x - 5H). (5.5) 

By the definition of mx in (|5.4p and the identity M x = Jxj Jx-> we deduce h°(M x (mx)) 7^ 
0. This together with the identification in (|5.5p yield 

H (M* x (m x )) = H°(Mx(-K x - (5 - m x )H)) ± 0. 

This non- vanishing is related to the H 1 of the tangent bundle @x via the normal sequence 
of X in P 4 , 

— ► O x — > ©p4 ® O x — ^ A6f — ► 0. 

Tensoring with Ox( — — (5 — mx)H) and passing to the the long exact sequence of 
cohomology groups, we obtain 

tf (6 P 4 8) Ox(--D)) — > H°(Mx(-D)) % H\® x (-D)) , (5.6) 

where we set D = ivTx + (5 — m x )H. In view of Lemma 15.2^ we are interested in the case 
m x < 5. The following result is a cohomological interpretation of that lemma. 

Lemma 5.3. If mx < 5, then the coboundary homomorphism 5x in (|5.6p is injective 
unless mx = 5, p g (X) < 2, and the degree of X in P 4 is at most 16. 

Proof. The failure of injectivity of 5x in ([5.6p implies the non- vanishing of 

H°(Q Fi ® Ox(-D)) = F°(9 P 4 ® Ox(-K x - (5 - m x )H)). 

Using the Euler sequence on P 4 , 

—> C P 4 — )■ i/ (O P 4(l))* ® O p4 (l) — ^ G P 4 0, 

it follows, by restriction to X, that either H°(O x (-K x - {A-m x )H)) or H l (O x (-Kx - 
(5 — m x )H)) must be nonzero. But for mx < 4 both groups vanish: the first one because 
X is of general type, and the second one because the divisor {K x + (5 — mx)H) is nef 
and big. Hence, we must have mx = 5, i.e. H°(@ F 4 <g> Ox{— K x ) ^ 0. 

From the Euler sequence, this non- vanishing can occur either if H°(Ox(H — Kx)) 7^ 0, 
or if 

ker [h\O x {-K x )) — > H (O x (H))* ® H\O x (H - K x ))) + 0. (5.7) 
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We consider each of these two cases. 

First case. If H°(O x (H - K x )) ^ 0, then 

either H = Kx, 

or H — Kx = I\ with V a non-zero effective divisor. (5-8) 

We claim that the former is impossible. Indeed, if H = Kx, then by pQ, X is a complete 
intersection of two hypersurfaces in P 4 . Since rax = 5, it follows that the degrees of these 
hypersurfaces are 5 and n > 5. But then, by the adjunction formula for Kx, we have 
Kx = nH, which contradicts H = Kx- Thus f|5.8 j) holds and we deduce 

p g (X) = h°(Ox(K x )) = h°(O x (H - T)) < 3. (5.9) 

Furthermore, the inequality must be strict, i.e. p g (X) < 2. Indeed, if the equality holds 
in (j5.9j) . then T is a line in P 4 . Intersecting both sides in (15.8P with the line T, we obtain 

i = h v = (Kx + r) • r = -2, 

which is absurd. Thus p g (X) < 2 and it remains to bound the degree d of X. From (15. 8p . 

H ■ K x = H 2 - T • H <d. 

Substituting this in the relation (j5.3j) . we obtain 

d 2 - 15d < 2K 2 - l2 x (O x )- (5.10) 

Since p g (X) < 2, it follows x(@x) < 3. This and the Bogomolov-Miyaoka-Yau inequality 
imply 

2K 2 - 12x(O x ) < 18. 
Putting this together with (|5.10p . we obtain d < 16. 

Second case. If ker (if 1 (0 X — > H°{O x (H))* ® H^OxiH - K x ))) + 0, let 
Xo be the minimal model of X. Since X is of general type, Xq is uniquely defined. Let 

/ ; X — ► X 

be the corresponding sequence of blowing-down maps. The canonical divisor of X can be 
written as follows: 

K x = f*K Xo + A (5.11) 

where A is the exceptional divisor of /. In particular, A is composed of rational curves 
on X contracted to points by /. Thus A • f*Kx = and f*Kx is nef and big — Xq is 
minimal and of general type. 

The non- vanishing of i?°(Oj>4 (g> Ox(-Kx)) implies the non- vanishing of iJ (Oj>4 <£> 
Ox(—f*Kx ))- From the Euler sequence and the fact that f*Kx is nef and big, the 
latter non- vanishing yields 

H°(Ox(H-rK Xo ))^0. 
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As before, there are two possibilities, either H = f*Kx , or H — f*Kx = T, with T 
effective and nonzero. Since H is very ample, the first possibility yields Xq = X and 
H = Kx which implies the vanishing of H (Ox{— Kx)), contrary to our assumption. 
Hence the latter possibility must hold. 

Arguing as in the first case, we deduce p g (X) < 3. Furthermore, the inequality must 
be strict. Indeed, if p g (X) = 3, then T is a line. Since H — f*Kx = T, it follows that 

H = K x + T - A. (5.12) 

Intersecting the both sides with the line T yields 

i = h ■ r = {K x + r) • r - a • r = -2 - a • r. 

Hence A • Y = —3 and the line T is a component of A, i.e. 

the divisor (A — V) is effective. (5.13) 

On the other hand, the condition (15. 7|) implies that for every h 6 H°(Ox(H)), the cup- 
product 

H\Ox(-K x )) A H\O x {H - K x )) 

has a nontrivial kernel. This implies that H°(Oc(H — Kx)) ^ 0, for every C in the linear 
system \H\. By (I5TT21) . H - K x = T - A, hence 

H°(O c (T - A)) ^ for every C £ \H\. (5.14) 

This, together with (I5.13p . implies A = T. Substituting it in fj5. 12f) leads to H = Kx 
which is impossible. Thus p g (X) < 2 and it remains to give the upper bound on d. 

From (l534j) . it follows that H ■ {T - A) > 0. This and (pTT2j) yield H ■ K x < H 2 = d 
and the rest of the argument is as in the first case. □ 

We now bring in an additional hypothesis: 

X is an irregular surface of general type with no irrational pencil. (5.15) 

This hypothesis combined with the assumption mx < 5 yield the following charac- 
terization. 

Lemma 5.4. Let mx < 5 and assume X to be subject to (|5. 15[) . Then mx = 4 or 5. 
Furthermore, 

• if m x = 4, then q(X) = 2 and 

K x = liH + F+ m cC+ ^ mil (5.16) 

C-H=2 l-H=l 

with fi>l,Fan effective divisor, and the sums run over collections of irreducible conies 
(C ■ H = 2) and lines (I ■ H = 1) contained in X ; 

• if mx = 5 and X is minimal, then q(X) < 3. Moreover, if equality holds, then one 
of the following can occur: 



24 



(i) Ox is generated by global sections, and K x = 6x(Ox)- 

(ii) The canonical divisor has the following form 

K x = nH + F + ^2 m c C + £ 

C-H=2 IH=1 

where fj, > 1, F is an effective divisor, and the sums are as in (|5.16j) . 

Remark. It is to be noticed that even if the coefficient [i above satisfies the same 
condition in both cases, these conditions occur for different geometric reasons. The proof 
will show that if mx = 4, then Kx = E and /i correspnds to the sum, fijj, of the coefficients 
of type II componenets of E, whereas if mx = 5 then L = H, i.e. Kx = H + E, and 
H = Hll + 1. 

Proof. The proof will be done in several steps. We begin by showing in Step 1 that 
mx = 4 or 5. Then, we go on with the detailed study of each value in Step 2 and Step 3. 

Step 1. Note that the hypothesis (|5.15p implies that the irregularity q{X) > 2. This 
and the fact that X is of general type yield p g (X) > 2 as well. Then, according to Lemma 
15. 3| the coboundary homomorphism S x in (15 .6|) is injective unless mx = 5, p g (X) < 2, 
and the degree of X in P 4 is at most 16. Hence, in this situation, p g (X) = q(X) = 2. 
Thus we may assume that 5x is injective, hence that H l {Qx{—Kx — (5 — m x )H)) ^ 0. 

Let r\ be a nonzero section of M(—Kx — (5 — m x )H) and let £ = d x (j]) be its image in 
H 1 (®x{—Kx — (5 — m x )H)). Viewing it as an extension class in Ext 1 (J7x ) Ox{— Kx — 
(5 — mx)H)) via the natural identification 

H^Qxi-Kx - (5 - m x )H)) Ext 1 ^, O x (-K x - (5 - m x )H)), 

we obtain the following exact sequence of locally free sheaves on X, 

— > Ox(-K x - (5 - m x )#) — ► T 5 — > O x — > 0. (5.17) 

Observe that the divisor (iTx + (5 — mx)H) is nef and big for mx < 5. This implies that 
H°(Tp) = H°(p, x ) and we consider the smallest saturated subsheaf T of 7^ containing the 
image of the evaluation map 

The hypothesis ()5. 15j) implies that the rank of T is at least 2. On the other hand, from 
the defining sequence (I5.17p . it follows that det(7^) = Ox{— (5 — m x )H). This implies 
that T has rank 2 unless mx = 5. In this case, with the additional assumption of X 
being minimal, we still have T of rank 2, unless T = T^ = © 3 Ox (these equalities follow 
immediately from det('Tg) = Ox)- This yields the case (i) of the lemma. 
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Thus we may assume that J- has rank 2 and we arrive at a diagram analogous to the 
one in 












(5-18) 

where Ox{L) = det(.F). By construction, the morphism <p£ is generically an isomorphism. 
Arguing as in the proof of Lemma f2.H we obtain the decomposition of the canonical divisor 

K X = L + E (5.19) 

where L is given by the determinant of T and E = ci(coker(y>£)) is a non-zero effective 
divisor. We also observe that the hypothesis (I5.15P implies that L is effective as well. 

Let e be a section of Ox(E) corresponding to the divisor E. Similarly to the statement 
of Lemma 12.41 we have that e annihilates the cohomology class £, i.e. 

e-£ = in H l {@x{E-K x - (5-m x )H)). (5.20) 

From the commutative diagram 

H°(Mx(—D)) H^Qxi-D)) (5.21) 

e e 

^°(9 P 4 (8) O x {E - D)) H°(M X (E - D)) H\Q X {E - D)) 

where D = Kx + (5 — mx)H, it follows that 

8 x (E)(e-7 ] ) = e-5x(v) = e-C = 0, 

where the last equality is (|5.20p . From this and the diagram (|5,2ip . it follows that the 
non-zero section e • rj of Mx(E — D) comes from i?°(0 F 4 ® Ox(E — D)). Thus, using the 
decomposition (|5.19|) . we obtain 

iJ" (e P 4 ® O x (-L - (5 - m x )H)) = H°(Q F 4 ® O x (E - K x - (5 - m x )H)) ^ 0. 
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From the Euler sequence of 6 P 4 , the non- vanishing of iT°(0 P 4 <g> Ox(—L — (5 — mx)H)) 
may occur for one of the following reasons: either 

H°(Ox(-L-(4-m x )H)) / 0, (5.22) 

or 

ker (H\O x (-L - (5 - m x )H)) -> H°(O x (H))* ® H\O x {-L - (4 - m x )#))) ^ 0. 

(5.23) 

It is obvious that (|5.22p implies that > 4. We claim that the same condition is 
necessary for f|5.23|) . Indeed, let ft be a nonzero section of Ox{H) and let Ch be the 
corresponding divisor in the linear system \H\. Then, from the exact sequence 

— ► O x (-L - (5 - m x )H) — ► O x (-L - (4 - m x )H) — ► 

— )■ Oc h (-i - (4 - mjt)E) — )■ 0, 

it follows that f|5.23|) forces the non-vanishing of the cohomology group H°(Oc h (—L — (4 — 
mx)H)). For this to hold, one must again have mx > 4. This completes the proof of 
the first assertion of the lemma. In the rest of the proof we consider separately the two 
possible values of mx- 

Step 2. If mx = 4, then the above argument shows that for (15. 22ft (respectively for 
(|5.23p ) to hold, L must be 0. This together with the definition of the sheaf T in f|5. 18j) 
imply 

T= (B 2 O x . 

In particular, q(X) = 2. 

Next we turn to the formula for Kx in (j5.16jl . For this, we use the decomposition of 
Kx given in (j5. 19|) . Due to L = 0, this simply reads 

Kx = E = Ej + En, 

where the last equality is as in (|3.4[) . Furthermore from the diagram (|5.18p with mx = 4, 
the conditions characterizing the curves of type I and type II become 

type I: deg Z c < deg rf c Z c = 2 - 2g(C) -H-C (5.24) 
type II: H°(O c (C - H)) + (5.25) 

where rjc ■ C — > C, in ()5.24p . denotes the normalization of C. 

From (I5.24p . it follows that the irreducible components of Ej are either lines, C-H = 1, 
or conies, C ■ H = 2. From (|5.25p . it follows that C — H = Fq is an effective divisor. 
Hence, the canonical divisor Kx satisfies 

K X = E = nuH + Yl m c p c + Yl mcC + 12 mi1 ' ^ 5 - 26 ) 

C of C-H=2 I H=1 

type II 

where mo stands for the multiplicity of a component D in Kx and 

H = fin = Y mc - 

C of type II 
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This formula contains all the ingredients of (|5.16|) except the assertion about u,jj. To see 
that, let us assume that fin = 0. Then 

K x = ^2 m c C + ^2 mil, 

C-H=2 IH=1 

i.e. the canonical divisor is composed entirely of rational curves. Thus it is contracted to 
points by the Albanese map and hence, the Zariski decomposition of Kx has no positive 
part, contradicting the fact that X is of general type. 

Step 3. If mx = 5 and X is minimal, then the construction of the subsheaf J- in (|5.18[) 
goes through and we may assume it to be of rank 2 (otherwise the argument in Step 1 
shows that (i) of the lemma holds). This gives the decomposition of the canonical divisor 
Kx as in (|5.19p . Continuing the argument as in Step 1, we arrive at 

H°(9 F 4®O x {-L)) y^O. (5.27) 

At this point we assume that the irregularity q(X) > 3 (otherwise there is nothing to 
prove). Consider the homomorphism 

A 2 H\F) — ► H°(O x (L)). (5.28) 

The hypothesis (|5.15|) and the argument in the lemma of Castelnuovo-de Franchis, see [21 
Proposition X.9], imply 

h°(O x (L)) > 2q(X) - 3 > 3. (5.29) 

We claim that this leads to 

O x (L) = O x {H). (5.30) 

Let us assume this and complete our argument. The inequality (|5.29p combined with 
flOO]) yield 

2q(X) - 3 < h°(O x (L)) = h°(O x (H)) = 5, (5.31) 

i.e. q(X) < 4. We will now rule out the case q(X) = 4. Indeed, if q(X) = 4 holds, the 
homomorphism in ()5.28j) has the form 

A 2 H°(F) — )> H°(O x (H)) (5.32) 

and must be surjective with a 1-dimensional kernel. Hence T is generated by global 
sections and it maps X into the Grassmannian Gr(l,3) = Gr(l, F(H°(J-)*)) of lines in 
¥(H°(T)*) = P 3 . Composing this map with the Pliicker map of the Grassmannian, we 
get 

X — > Gr(l, 3) F(A 2 H°{T)*) = P 5 

Furthermore X C P 4 is contained in the intersection of the Pliicker embedding of the 
Grassmannian Gr(l,3) with the hyperplane in ¥(A 2 H (J r )*) corresponding to the kernel 
of the homomorphism in (I5.32p . The image of Gr(l, 3) under the Pliicker map is a quadric. 
Hence X C P 4 is contained in a quadric which is impossible by the first assertion of the 
lemma. 

Thus q(X) = 3 and the decomposition in (|5.19p reads as follows: 

K X = H + E = H + E II + E I (5.33) 
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where we use again the decomposition of E into types. Furthermore, the irreducible 
components of E are subject to the same conditions as in (|5.24[) and (|5,25p . This leads to 
the formula for E as in (|5.26p . Substituting it into (|5.33p yields 

K x = inn + 1)H+ m cF c + Yl m ° C + Yl ml 

C of C-H=2 I H=1 

type II 

where the notation have the same meaning as in (|5,26p . □ 

Proof of (I5.30p . For mx = 5 the conditions (|5.22p and (|5.23p become respectively 
H°(Ox(H - L)) ^0 and 

ker (h\O x {-L)) — > H (O x (H))* ® H\O x (H - L))) + 0. (5.34) 
Claim. H°(O x {H - L)) ^ 0. 

This claim implies the equality (|5.30p . Indeed, assume H — L = T ^ 0. Then we have 

h°(Ox(H-T)) = h°(Ox(L))>3, 

where the last inequality comes from (15.29H . This implies that the equality must hold and 
that r is a line in P 4 . Thus 

H = L + T = K - E + T (5.35) 
Taking the intersection with T, we have 

i = r • h = r • (k x + r) - r • e = -2 - r • e. 

From this it follows that E - V = —3 which contradicts Remark 13.51 

We now turn to the proof of the claim, H°(Ox{H — L)) ^ 0. From (|5.29p . it follows 
that 

L = M + F (5.36) 

where M (resp. F) is the moving (resp. fixed) part of L. In particular, M is nef, 
and since X has no irrational pencil, it is also big. The non-vanishing of the group 
J ff°(G P 4 (8) O x (-L)) (see (15371) ) implies that 

H°{9 F 4®O x (-M)) ^0 

as well. From the Euler sequence of Gp4 it follows that this group is the middle term of 
the exact sequence 

H°(Ox(H))* ® H°(O x (H - M)) — > #°(9 P 4 ® O x (-M)) — > H x (O x (-M)). 

The fact that M is nef and big yields H 1 (O x (-M)) = 0. Hence H°(O x (H - M)) £ 0. 
Using this non- vanishing and the decomposition (|5.36p . L = M + F, we see that 

L = H + D, (5.37) 
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with D an effective divisor. Indeed, H°(O x (H - M)) ^ if either M = H, and D = F in 
([537]), or H-M = 1, with Z a line since h°(O x (H - /)) = /i°(0 x (M)) = h°(O x (L)) > 3. 
Now I ■ E > —2 (see Remark 13. 5p . hence 

> / • (i^x + I - E) = I ■ (L + I) = I • (JET + L - M) = I ■ (JET + F) = 1 + 1 ■ F. 

It follows that I is contained in F and we take D = F — I to obtain the decomposition in 
(153711 . 

We now use (I5.37P to show that the kernel in (]5.23h vanishes. Indeed, a non-trivial 
element of this kernel gives rise to the non-trivial kernel for the cup product 

H\O x {-L)) A H\O x {H - L)) 

for every h G H°(O x (H)), Thus H (O Ch (H - L)) ^ 0, where C ft = {/i = 0} is the 
divisor corresponding to h. Substituting for L the expression (|5,37p . we deduce that 
H°(Oc(—D)) ^ for every divisor C in the linear system \H\. Since D is effective, we 
obtain that D = and thus L = H. This implies the vanishing of H l {O x (—L)) in (I5.34p . 
hence H° {O x (H - L)) / 0. □ 

Proof of Theorem \ 5.1\ Let d(x, P) be as in Lemma [5.21 and let X 6 <S^(x, P)- By 
Lemma |5.2| X is contained in a 3- fold of degree m x < 5. From Lemma [5.41 it follows that 
m x is either 4 or 5, and that q(X) < 3. Furthermore, if q(X) = 3, then (i) or (ii) of 
Lemma 15.41 must hold. □ 

Remark. The well-known example of Horrocks and Mumford in [9] is essentially the 
only known surface in P of irregularity 2. Though Theorem 15.11 does not rule out the 
possibility of surfaces in P 4 with irregularity 3, it shows, following [4, Proposition 4.1], 
that such a hypothetical surfac^l could be a divisor in an Abelian variety of dimension 3. 

Using similar reasoning, we can restrict the topology of surfaces of high degree and 
bounded holomorphic Euler characteristic in P 4 . 

Theorem 5.5. Given a positive integer n, every surface X in Sd{Xi P) ^ as negative 
topological index, i.e. a x > 1/2, provided d > d(x,P)- (The notation Sd(,XiP) an d d(x, P) 
are to be found in (15. ip and Lemma 15. £1 respectively.) 

Proof. By Lemma 15. 2\ X is contained in a 3- fold of degree m x < 5. Following the 
arguments in Lemma 15.31 and Lemma 15.4} we deduce that F 1 (G x (-i^x)) + 0. This 
implies the decomposition of K x = L + E and that H°(Q ¥ 4 <g> O x (—L)) ^ 0. The latter 
condition yields 

H-L<H 2 = d. (5.38) 
Claim. If a x < 1/2, then EH <L-H. 

To justify the claim, we assume the opposite, E ■ H > L-H. From this and Lemma [27 
1), we deduce 

{E-L)- (K x + XH) = 



2 The condition (ii) of Lemma 15.41 could be envisaged as a degenerate case of (%). 
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for some A > 0. By the Hodge index and Lemma 12.31 2), it follows that E is numerically 
equivalent to L, which contradicts Lemma 12.31 !)■ 

To end the proof of the theorem, we combine the claim and (|5.38p to deduce 
H ■ K x = H ■ (L + E) < 2H ■ L < 2d. 
This inequality and (|5,2p yield 

2d>H-K x = -(d 2 - lOd - 2(B - 6)y). 
5 

Hence, when the corresponding discriminant is not negative, 

d < 10 + VlOO + 2(/3 - 6)x < d( X , P). 

□ 
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